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© Video data compression. 



© A video data compression system is described 
utilising frequency separation and quantization. The 
video data is separated into primary frequency com- 
ponents (components 4, 5, 6) and secondary fre- 
quency components (components 0, 1, 2, 3). The 
primary frequency components undergo fewer fre- 
quency separating stages (N > M) than the secon- 
dary frequency components. The quantization step 
width (Qi, Ch) applied to the differing primary and 
secondary components is varied in dependence 
upon the relative human visual responsiveness (R- 
(f s )) to the spatial frequency (f s ) represented by that 



component. In addition, those frequency components 
that have undergone fewer frequency separating 
stages are subject to a larger quantization step width 
than the other frequency components since the few- 
er frequency combination stages such frequency 
components will subsequently undergo has the re- 
sult that the image degradation introduced by quan- 
tization is less noticeable. The system also includes 
entropy encoding (42) using selectable complemen- 
tary encoding and decoding tables. The system is 
particularly applicable to recording and reproducing 
apparatus. 
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This invention relates to the field of video data 
compression. More particularly, this invention re- 
lates to the field of video data compression in 
which frequency separation and quantization are 
used. 

British Published Patent Application GB-A-2 
251 756 (Sony Broadcast & Communications Limit- 
ed) describes a system using sub band frequency 
separation and quantization as part of a data com- 
pression process. Sub band frequency separation 
is used to decorrelate the video data into spatial 
frequency components of uniform size within the 
two-dimensional spatial frequency domain. The 
spatial frequency component data is then subject 
to a quantization process whereby the data repre- 
senting the spatial frequencies to which the human 
visual system is less receptive is quantized more 
heavily than other spatial frequency component 
data. The degree of quantization applied to each 
spatial frequency component is chosen to follow an 
empirically determined relationship between rela- 
tive human visual responsiveness at differing spa- 
tial frequencies. In general, the lower spatial fre- 
quency components are less heavily quantized 
than the higher spatial frequency components. 

Another video data compression system is de- 
scribed in IEEE Transactions on Circuits and Sys- 
tems for Video Technology, Volume 1 , No. 2, June 
1991, pages 174 to 183, "Sub band Coding Al- 
gorithms for Video Application: Videophone to 
HDTV-Conferencing" by Hamid Gharavi. In contrast 
to the above, a video compression system is dis- 
closed which separates the data into sub band 
components in the two-dimensional spatial frequen- 
cy domain of non-uniform size. This form of fre- 
quency separation is also known as "wavelet" cod- 
ing. The frequency separated data is passed via a 
quantizer to a buffer store. The buffer store is 
continuously loaded with the compressed data and 
continuously emptied as the data is read for trans- 
mission . The degree of quantization is controlled 
based upon the spare capacity within the buffer 
store so as to avoid a disadvantageous overflow or 
underflow of the buffer store. 

A constant aim within video data compression 
systems is to achieve a higher degree of data 
compression with a reduced degree of degradation 
in image quality upon decompression. Generally 
speaking, the higher the degree of compression 
used, the greater will be the degradation in the 
image when it is decompressed. More specifically, 
higher degrees of compression can be achieved by 
using heavier quantization (i.e. larger quantization 
step widths), but quantization is a non-reversible 
process and heavier quantization will result in an 
increase in degradation in the image when it is 
decompressed. 



Viewed from one aspect this invention provides 
a video data compression apparatus comprising: 

means for frequency separating input video 
data into one or more primary components, each 

5 representing a range of spatial frequency content 
within said input video data, usjng M frequency 
separating stages and a plurality of secondary 
components, each representing a range of spatial 
frequency content within said input video data, 

w using N frequency separating stages, N being 
greater than M; and 

a quantizer for quantizing each of said primary 
components with a primary quantization step width 
Qi and for quantizing each of said secondary com- 

15 ponents with a secondary quantization step width 
Q2, where Q1 and G2 are substantially given by: 

Q1 = K!/R(fi) and Q 2 = K 2 /R(f 2 ), 

20 with 

R(fs) = relative human visual responsiveness at 

differing spatial frequencies f s , 

f s = spatial frequency in cycle per degree of visual 

angle, 

25 fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
secondary component being quantized, and 
K1 and K 2 are constants with K1 > K 2 . 

30 This invention both recognises and exploits 

that the perceivable degradation in an image due to 
an error (e.g. a deviation from the true value caus- 
ed by quantization) is dependent upon the number 
of stages of interpolation to which that error is 

35 subjected to produce the decompressed image in 
the spatial domain. A stage of interpolation can be 
considered to be the operation of frequency sepa- 
rating the data in both the horizontal and vertical 
directions. In the case of 64 sub band components 

40 of equal size, as disclosed in GB-A-2 251 756, 
each sub band component is subject to three fre- 
quency combinations (interpolation) stages (three 
horizontal and three vertical) to transform it back 
into the spatial domain. In each of these stages, 

45 any error present will be spread further in the 
reconstructed image. 

In the case of frequency separation in which 
different frequency components have undergone a 
different number of stages of separation, and will 

so therefore require a different number of stages of 
combination, the effect of a particular error in a 
given component will vary in a manner that can be 
exploited to achieve better overall compression. 
More particularly, those frequency components that 

55 will be subject to fewer stages of combination can 
be more heavily quantized relative to those that will 
be subject to more stages of combination. In prac- 
tice, the degree of quantization is already varied 
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between different frequency components, as de- 
scribed in GB-A-2 251 756, and this variation of 
quantization between frequency components is 
modified further to take into account the relative 
number of combination stages to which each fre- 
quency component will be subjected. 

In GB-A-2 251 756, the variation of quantization 
between frequency components is inversely pro- 
portional to the relative human visual responsive- 
ness at the spatial frequency characteristic of that 
frequency component. In embodiments of the 
present invention, this relationship is modified such 
that the quantization is proportional to respective 
constants Ki and K2, with K1 > K 2 depending upon 
the number of frequency separating stages, and 
consequently frequency combination stages, that 
the particular frequency component has undergone. 

The invention allows an improvement in the 
decompressed image quality for a given degree of 
compression or, alternatively, an improvement in 
the degree of compression for a given degree of 
quality in the decompressed image. 

It is known to provide video compression sys- 
tems in which frequency separation and quantiza- 
tion are combined with entropy encoding, e.g. run- 
length coding followed by Huffman coding. In pre- 
ferred embodiments of the invention there is pro- 
vided an entropy encoder for entropy encoding 
quantized primary and secondary component data 
output from said quantizer with a selectable one of 
a plurality of encoding tables. 

Matching the particular entropy coding table 
being used to the frequency component being pro- 
cessed allows an advantageous increase in the 
degree of compression that can be achieved. 

The means for frequency separating input vid- 
eo data could take a number of forms. However, it 
is particularly convenient if said secondary compo- 
nents are produced by further separating one or 
more primary components. 

It will be appreciated that the relative human 
visual responsiveness R(f s ) at differing spatial fre- 
quencies f s is an empirically determined quantity 
measured over a plurality of tests subjects. How- 
ever, in preferred embodiments of the invention 
good results have been achieved when R(f s ) is 
substantially given by: 

R(f s ) = a * (1 - e~ b - ,s ) * (e-° ts + (0.33 * e -°- 33 cts )), 
with 

0.8 < a < 1.2, 
1.4 < b < 1.8, and 
0.3 < c < 0.5. 

The above human responsiveness R(f s ) is par- 
ticularly suited for use upon luminance video data 
and when a = 1.0, b = 1.6 and c = 0.4. 



As one alternative, good results are also 
achieved when R(f s ) is substantially given by: 

R(f s ) = a * (1 - e _b - ,s ) * e- c ,s , 

5 

with 

1.15 < a < 1.55, 

1.4 < b < 1.8, and 
0.25 < c < 0.45. 

10 This alternative is particularly suited for use 

upon blue colour difference chrominance video 
data and when a = 1 .35, b = 1 .6 and c = 0.35. 

As another alternative, good results are also 
achieved when R(f s ) is substantially given by: 

75 

R(f s ) = a * (1 - e" bfs ) * e- cJs , 
with 

1.5 < a < 1.9, 

20 1 .4 < b < 1 .8, and 
0.5 < c < 0.7. 

This alternative is particularly suited for use 
upon red colour difference chrominance video data 
when a = 1.7, b = 1.6 and c = 0.6. 

25 The human eye is less responsive to blue 

colour difference signal than to red colour dif- 
ference and luminance signals. This can be ex- 
ploited by more heavily quantizing the blue colour 
difference signals to yield greater compression 

30 without an undue degradation in image quality 
upon decompression. However, in some systems it 
may be desired to use the blue colour difference 
signal, or the information content thereof, for some 
process other than direct display for human view- 

35 ing, e.g. downstream chroma-keying. In this case it 
is desirable to preserve the blue colour difference 
resolution to above that otherwise justified by its 
relative human visual responsiveness. 

It will be seen from the above, that this com- 

40 pression technique can be used to compress either 
or both luminance video data and chrominance 
video data in which case, the appropriate ones of 
the above relationships between human visual re- 
sponsiveness and spatial frequency are used. 

45 Whilst the number of frequency separating 

stages M and N can vary, it has been found 
desirable that M = 1 and N = 2. 

In practice, each frequency separation and in- 
terpolation stage will introduce an error and so an 

50 advantageous balance between improved decor- 
relation and the number of stages involved is 
reached when M = 1 and N = 2. 

As explained above, the frequency components 
that are subject to fewer frequency separation, and 

55 subsequent frequency combination, stages may be 
more heavily quantized than would otherwise be 
expected. It has been found particularly appropriate 
to use embodiments in which K1/K2 is substantially 
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equal to 2. 

As explained above, the number of primary 
and secondary components can vary, but in pre- 
ferred embodiments it has been found convenient 
that said means for frequency separating separates 
said input video data into three primary compo- 
nents representing a high spatial frequency portion 
of said video data and four secondary components 
representing a low spatial frequency portion of said 
video data. 

It will also be appreciated that other compo- 
nents in addition to the primary and secondary 
components may be present, e.g. in a three stage 
"wavelet" coding there will be primary, secondary 
and tertiary components. The significance of the 
technique is based upon the relative quantization of 
components subject to different degrees of separa- 
tion. 

In order to prevent the extra frequency separa- 
tion stages undergone by the secondary compo- 
nents from resulting in an increase in the amount of 
data in the spatial frequency domain said primary 
components are of a higher spatial resolution than 
said secondary components. 

In the preferred embodiment using three pri- 
mary components and four secondary components 
it is convenient to provide that said primary compo- 
nents have a spatial resolution twice that of said 
secondary components. 

As previously mentioned, it will be appreciated 
that the means for separating could be formed in a 
number of different ways. However, in preferred 
embodiments it is convenient that said means for 
separating comprises a branching hierarchy of low 
and high pass filters. Such filters can provide so 
called 'perfect 1 reconstruction in the manner de- 
scribed in copending British Patent Application 
9111782.0 (Sony Broadcast & Communications 
Limited). 

An effective way of forming low and high pass 
filters is to provide that said low and high pass 
filters comprise complementary finite impulse re- 
sponse filters. 

Viewed from, another aspect this invention also 
provides a video data decompression apparatus 
comprising: 

a dequantizer for dequantizing each of one or 
more primary components, each representing a 
range of spatial frequency content within said input 
video data, with a primary dequantization step 
width Qi and dequantizing each of a plurality of 
secondary spatial frequency components, each re- 
presenting a range of spatial frequency content 
within said input video data, with a secondary de- 
quantization step width Q 2 , where Q^ and Q 2 are 
substantially given by: 

Qi = -Ki/R(fi) and Q 2 = K 2 /R(f 2 ), 



with 

R(f s ) = relative human visual responsiveness at 
differing spatial frequencies f s , 
5 f s = spatial frequency in cycle per degree of visual 
angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
w secondary component being quantized, and 
Ki and K2 are constants with K1 > K 2 ; and 

means for frequency combining said dequan- 
tized primary components with M frequency com- 
bining stages and said dequantized secondary 

75 components with N frequency combining stages, N 
being greater than M. 

As previously mentioned, the overall perfor- 
mance of the system is improved if entropy coding 
is used. Accordingly, the decompression apparatus 

20 advantageously includes an entropy decoder for 
entropy decoding compressed data into said quan- 
tized primary components and said quantized sec- 
ondary components with a selectable one of a 
plurality of decoding tables. 

25 In this way encoding, and complementary de- 

coding, tables can be made to match the particular 
components being processed. 

It will be appreciated that the video data com- 
pression and decompression apparatus of the in- 

30 vention can be used in various different contexts. In 
particular, video data compression and decompres- 
sion has application to fields such as point to point 
transmission and video conferencing. However, this 
invention has particular application to a video data 

35 recording and reproducing apparatus in which im- 
proved data compression is needed in order to 
increase the running time of the storage medium 
whilst not unduly degrading the image quality. 

In such a recording and reproducing apparatus, 

40 it is usual for some data losses to occur due to 
imperfections in the recording medium and the like. 
In such a circumstance, the visible effect of these 
errors can be reduced by preferred embodiments 
comprising: 

45 multichannel recording and reproducing heads; 

a demultiplexer for splitting adjacent samples 
within each of said primary components and said 
secondary components between different recording 
channels; and 

50 a multiplexer for combining samples from dif- 

ferent reproducing channels to reform each of said 
primary and said secondary components. 

The combination of demultiplexing adjacent 
samples within the components and the fact that 

55 the components are in the spatial frequency do- 
main rather than the spatial domain (i.e. demul- 
tiplexing after wavelet coding) has the effect of 
retaining coding efficiency whilst reducing the visi- 
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content of the image. Generally speaking, even 
without the compression process, there is more 
information^.contained in the lower frequency com- 
ponents than in the higher frequency components. 
Using the compression process further reduces the 
information content of the higher frequency compo- 
nents relative to the lower frequency components. 
This decorrelation is used to achieve efficient cod- 
ing by subsequently applying techniques such as 
runlength coding and entropy coding. A system 
using the frequency separation technique as illus- 
trated in Figure 1 is described in more detail in 
GB-A-2 251 756. Figure 2 illustrates the relative 
human visual responsiveness R(f s ) to luminance at 
different spatial frequencies f s , Spatial frequency f s 
is measured in cycles per degree of visual angle 
so as to independent of viewing distance from the 
video image reproduction apparatus. The relative 
visual responsiveness R(f s ) is determined empiri- 
cally using a threshold type testing procedure 
whereby luminance variations at a given spatial 
frequency are increased in magnitude until they are 
perceived by the viewer. 

Figures 3A and 3B illustrates the relative hu- 
man visual responsiveness R(f s ) to chrominance at 
differing spatial frequencies in an analogous man- 
ner to Figure 2. The chrominance signals can be 
B-Y or R-Y colour difference signals. It will be seen 
that the relative human visual responsiveness to 
chrominance has a sharper peak at the low spatial 
frequencies and more rapidly declines to zero to- 
wards the high spatial frequencies. 

Both Figure 2 and Figures 3A and 3B illustrate 
the variation in relative visual responsiveness at 
differing spatial frequencies (given in cycles per 
degree of visual angle) in one dimension. A surface 
mapping the relative human visual responsiveness 
to spatial frequency in two dimensions can be 
obtained by rotating each of the curves of Figure 2 
and Figures 3A and 3B about the R(f s ) axis. Figure 
3A shows the R-Y colour difference responsiveness 
and Figure 3B shows the B-Y colour difference 
responsiveness. The magnitudes of the R-Y re- 
sponsiveness are greater than those of the B-Y 
responsiveness in line with the empirically deter- 
mined relationships discussed above. 

Figure 4 illustrates an image transformed into 
non-uniform frequency components in the two-di- 
mensional spatial frequency domain. The image is 
transformed into three primary components (com- 
ponents 4, 5, 6) and four secondary components 
(components 0, 1, 2, 3). The component 0 cor- 
responds to the DC subband of Figure 1. Each of 
the secondary components occupies one quarter of 
the area in the spatial frequency domain compared 
to the primary components. Moving rightwards and 
downwards in the transformed image corresponds 
to an increase in spatial frequency. The primary 



components are subject to one stage of frequency 
separation and subsequently one stage of frequen- 
cy combination, whereas the secondary compo- 
nents are subject to two stages of frequency sepa- 
5 ration and subsequently two stages of frequency 
combination. 

Figure 5 illustrates the stages in the frequency 
separation process. An image 4 in the spatial do- 
main is first subject to complementary low and 
w high pass filtering in both the horizontal and vertical 
directions to split it into four primary sub bands in 
the spatial frequency domain 6 (Stage 1). The 
lowest frequency component 8 corresponds to the 
DC component 2 of Figure 1 and Figure 2. 

75 The lowest frequency component 8 alone is 

then subject to further splitting by low and high 
pass filters in both the horizontal and vertical direc- 
tions to form four secondary components (Stage 
2). The primary components (components 4, 5, 6) 

20 other than lowest frequency component 8 remain 
unchanged during Stage 2. 

The spatial frequency separation by low and 
high pass filtering includes decimation of the sam- 
ple data so as to maintain as constant the number 

25 of data values representing the particular content of 
the image in a different domain. 

Figure 6 illustrates the relative quantization 
step widths applied to the primary and secondary 
components. The quantization step widths increase 

30 as spatial frequency increases. The quantization 
step widths for the primary components are double 
those that would be used if based purely upon the 
relative human visual responsiveness as illustrated 
in Figure 2 and Figure 3. The quantization step 

35 widths increase less rapidly with increasing vertical 
spatial frequency since the image in the spatial 
domain is an interlaced field image rather than 
being a full vertical resolution frame image. 

Figure 7 illustrates the variation in quantization 

40 step width with spatial frequency as used in Figure 
6. The curve ABC represents the inverse of the 
curves illustrated in either Figure 2 or Figure 3 
depending on whether it is luminance or chromin- 
ance data that is being processed. The curve ABC 

45 is that used to generate the quantization step 
widths in the system disclosed in GB-A-2 251 756. 
In contrast, for this embodiment of the present 
invention, the curve DE is used to derive the quan- 
tization step widths for the tipper half of the spatial 

so frequencies. For a given point along the curve BC, 
the corresponding point of the same spatial fre- 
quency along the curve DE represents double the 
quantization step width. There is a discontinuity at 
BD. 

55 Figure 8 schematically illustrates a branching 

hierarchy of low and high pass filters that can be 
used to perform non-uniform frequency separation. 
Input video data 10 is split into a low frequency 
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bility of the results of any errors should these 
occur. 

. Jn. order to assist in the reproduction of an 
image in circumstances, such as shuttle, in which 
only part of the data is recovered, it is advanta- 5 
geous to provide a formatter for formatting said 
compressed data in blocks of data each containing 
a header identifying a spatial frequency domain 
position to which compressed data within said 
block relates. These data blocks can be made 10 
further independent by providing that each block 
includes error correction data for that block. 

Viewed from a further aspect this invention also 
provides a method of compressing video data com- 
prising the steps of: 75 

frequency separating input video data into one 
or more primary components, each representing a 
range of spatial frequency content within said input 
video data, using M frequency separating stages 
and a plurality of secondary components, each 20 
representing a range of spatial frequency content 
within said input video data, using N frequency 
separating stages, N being greater than M; and 

quantizing each of said primary components 
with a primary quantization step width Ch and for 25 
quantizing each of said secondary components 
with a secondary quantization step width Q 2 , where 
Q1 and Q2 are substantially given by: 

Q1 = K,/R(fi) and Q 2 = K 2 /R(f 2 ). 30 

with 

R(f s ) = relative human visual responsiveness at 
differing spatial frequencies f s , 

f s = spatial frequency in cycle per degree of visual 35 
angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
secondary component being quantized, and 40 
K1 and K2 are constants with K1 > K2 . 

Viewed from still further aspect this invention 
also provides a method of decompressing video 
data comprising the steps of: 

dequantizing each of one or more primary 45 
components, each representing a range of spatial 
frequency content within said input video data, with 
a primary dequantization step width Q1 and de- 
quantizing each of a plurality of secondary compo- 
nents, each representing a range of spatial fre- so 
quency content within said input video data, with a 
secondary dequantization step width Q 2 , where Q1 
and Q2 are substantially given by: 

Q1 = Ki/R(fi) and Q 2 = K 2 /R(f 2 ), 55 
with 

R(f s ) = relative human visual responsiveness at 



differing spatial frequencies f s , 

f s = spatial frequency in cycle per degree of visual 

angle, 

fi = a spatial frequency representative of that 

primary component being quantized, 

f 2 = a spatial frequency representative of that 

secondary component being quantized, and 

K1 and K2 are constants with K1 > K 2 ; and 

frequency combining said dequantized primary 
components with M frequency combining stages 
and said dequantized secondary components with 
N frequency combining stages, N being greater 
than M. 

An embodiment of the invention will now be 
described, by way of example only, with reference 
to the accompanying drawings, in which: 

Figure 1 illustrates an image transformed into 
uniform subband components in the two-dimen- 
sional spatial frequency domain; 
Figure 2 illustrates the relative human visual 
responsiveness to luminance levels at differing 
spatial frequencies; 

Figures 3A and 3B illustrate relative human vi- 
sual responsiveness to R-Y and B-Y colour dif- 
ference chrominance signal levels at differing 
spatial frequencies; 

Figure 4 illustrates an image transformed into 
non-uniform frequency components (wavelet 
coding) in the two-dimensional spatial frequency 
domain; 

Figure 5 illustrates a two-stage process for 
transforming an image into the form illustrated in 
Figure 4; 

Figure 6 shows quantization step widths as ap- 
plied to the different frequency components of 
Figure 4; 

Figure 7 illustrates the variation of quantization 
step width used to produce the quantization step 
width values of Figure 6; 

Figure 8 illustrates a branching hierarchy of low 
and high pass filters for performing frequency 
separation into non-uniform components in one 
dimension; 

Figure 9 illustrates one form of frequency sepa- 
rator; 

Figure 10 illustrates another form of frequency 
separator; 

Figure 11 illustrates a video data recording and 
reproducing apparatus; 

Figure 12 illustrates a data block as recorded 
and reproduced by the apparatus of Figure 11. 
Figure 1 illustrates an image transformed into 
uniform subband components in the spatial fre- 
quency domain. The image is transformed into 8*8 
components. Passing rightwards or downwards 
within the array of components corresponds to an 
increase in spatial frequency. The upper leftmost 
component 2 corresponds to the substantially DC 



5 



11 



EP 0 588 476 A2 



12 



portion 12 and a high frequency portion 14 by 
respective low and high pass filters. These low and 
high-.frecjtjency portions 12, 14 are decimated so as 
to preserve the overall data rate. The low fre- 
quency portion 12 is further split by a second 
stage of low and high pass filtering to produce a 
low frequency portion 16 and a high frequency 
portion 18. Once again, the Jow and high frequency 
portions 16, 18 are decimated so as to preserve 
the data rate. The low frequency portion 14 result- 
ing from the first stage of frequency separation 
forms a primary component. The low and high 
frequency portions 16, 18 resulting from the sec- 
ond stage of frequency separation form secondary 
components. 

The frequency splitting illustrated in Figure 8 is 
in one dimension. It will be appreciated that fre- 
quency splitting in the other dimension will be 
achieved with another branching hierarchy of filters. 
The filters used are finite impulse response filters 
employing either sample or line delays depending 
upon whether horizontal or vertical filtering is re- 
quired. 

Figure 9 illustrates one form of the means for 
frequency separating. Input video data 20 is sup- 
plied to a complementary low and high pass filter 
arrangement 22 where it is split into two horizontal 
bands using finite impulse response filters with 
sample delays. The data thus split is then passed 
to another low and high pass filter arrangement 24 
where it is further split into two vertical bands using 
finite impulse response filters with line delays. The 
data output from the filter arrangement 24 is sam- 
ple multiplexed with interleaved high and low com- 
ponents as described in copending British Patent 
Application 9118167.7 (Sony Broadcast & Commu- 
nications Limited). At this point the image is written 
into a field store 26 which serves to convert it from 
sample multiplexed form into the form illustrated 
after Stage 1 in Figure 5. 

The lowest horizontal and vertical frequency 
component from the primary components stored in 
the field store 26 is then subject to a second stage 
of horizontal and vertical frequency splitting by the 
high and low pass filter arrangements 28, 30. The 
high and low pass filter arrangements 28, 30 are 
disabled for the remaining primary components 
other than the lowest horizontal and vertical fre- 
quency primary component. The output from the 
filter arrangement 30 is written into the field store 
31 where it is transformed from sample multiplexed 
form into the form illustrated after Stage 2 in Figure 
5. 

Figure 10 illustrates another embodiment of the 
means for frequency separating. In this embodi- 
ment, input data 20 is subject to a first stage of 
horizontal frequency separation by the filter ar- 
rangement 22 (sample delays) and then the lower 



horizontal frequency component alone is subject to 
a second stage of horizontal frequency separation 
by the filter arrangement 25. The data is then 
written into field store 27 where it is transformed 
5 from its sample multiplexed format into a format in 
which the differing horizontal components are sep- 
arated. 

The data from the field store 27 is then trans- 
posed and passed through a first stage of vertical 

w filtering by the filter arrangement 23 (sample de- 
lays can be used since data has been transposed; 
this is easier to implement than having to provided 
the buffering necessary for line delays) and then 
the lower vertical frequency components alone is 

75 subject to a second stage of vertical frequency 
separation by the filter arrangement 29. The output 
from the filter arrangement 29 is then written into a 
field store 31 where it is rearranged into the format 
shown. As a consequence of both stages of hori- 

20 zontal filtering being performed before the vertical 
filtering is that the low horizontal and high vertical 
spatial frequency component of Figure 9 is now 
split in two horizontally since at the time of the 
second stage of horizontal filtering there has not 

25 yet been any vertical frequency separation that 
could be used to avoid this extra splitting. The 
effective quantizing steps applied to these two 
areas is scaled by a factor of 2 1/2 rather than 2 as a 
result of the extra stage of horizontal decimation. 

30 Figure 11 illustrates a recording and reproduc- 

ing apparatus 32. Input data 34 is supplied to a 
wavelet decimation unit 36 where it undergoes fre- 
quency separation as illustrated in Figure 5. The 
frequency separated data is then demultiplexed by 

35 a demultiplexer 38 onto four separate processing 
channels A, B, C, D whereby adjacent samples 
within the array of samples are placed on differing 
channels as schematically illustrated below the de- 
multiplexer 38 in Figure 1 1 . 

40 The four channels of demultiplexed data A, B, 

C, D are then fed to a quantizer 40 where they are 
subject to individual channel quantization using the 
quantization step widths given in Figure 6 in de- 
pendence upon which frequency component the 

45 data being processed originates from and the over- 
all data rate required. 

The quantized data is then passed to an en- 
tropy encoder 42 where it is subject to runlength 
and Huffman coding. The entropy encoder 42 uses 

so different coding tables for the different frequency 
components. 

The frequency transformed, demultiplexed, 
quantized and entropy encoded data is then pack- 
aged into data blocks by a channel encoder 44. 

55 These data blocks are then written via a tape 
transport mechanism onto a magnetic tape 46. 

As an alternative to the above the DC compo- 
nent data may be subject to differential coding 
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(DCPM) to improve coding efficiency. The DC val- 
ues are typically represented by 12 bit numbers. 
The differences are encoded as modulo 2 12 values 
irrespective of whether they are positive or nega- 
tive differences. Upon decoding the difference are 5 
added to the current 12 bit number with any carry 
bits being ignored. In this way a negative dif- 
ference can be achieved by adding a large number 
that takes the total through a bit carry and returns a 
modulo 2 12 result that is lower than the previous io 
total. Avoiding the need to support negative differ- 
ences with a sign bit or the like simplifies im- 
plementation. 

Data blocks recovered from the magnetic tape 
46 are read by a channel decoder 48 which at- 75 
tempts a first level of error correction and marks 
any data subject to error. The channel decoder 
then passes the data to a replay store and time 
base corrector 50. The replay store and time based 
corrector 50 allows an image to be produced when 20 
only some of the data is recovered by utilising data 
previously written into the replay store. 

The data from the replay store and time base 
corrector 50 is fed to an entropy encoder 52 where 
it is decoded in a complementary manner to the 25 
encoding process applied by the entropy encoder 
42. The entropy decoder 52 uses selectable de- 
coding tables dependent upon which frequency 
component the data being decoded originates 
from. 30 

The output from the entropy decoder 52 is fed 
to a dequantizer 54 which dequantizes the decoded 
data using a dequantization step width complemen- 
tary to that applied for the frequency component 
being processed by the quantizer 40. 35 

The output from the dequantizer 52 is fed to a 
multiplexer 56 where the four channels A, B, C, D 
are combined and then passed to an error conceal- 
ment unit 58. The error concealment unit 58 per- 
forms error concealment upon any samples flagged aq 
as erroneous by the channel decoder 48 using a 
selectable strategy of interpolating replacement val- 
ues from surrounding values. The strategy can be 
adapted in dependence upon which frequency 
component the error being concealed is present in. 45 

The output from the error concealment unit is 
fed to wavelet reconstruction unit 60 where the 
data is transformed from the spatial frequency do- 
main to the spatial domain by a complementary 
array of interpolation filters to the frequency sepa- 50 
ration filters in the wavelet decimation unit 36. The 
output 62 from the wavelength reconstruction unit 
is a reproduced image in the spatial domain. 

Figure 12 illustrates a data block of the type 
into which the image data is split and recorded 55 
upon the magnetic tape 46 of Figure 11. The data 
block includes a two byte fixed synchronisation 
pattern 64, a two byte channel identifier 66 (indicat- 



ing which of channels A, B, C, D the data is from), 
a four byte entropy encoding identifier 68 indicat- 
ing which entropy coding table was used for the 
following video data 70. The entropy coding iden- 
tifier 68 also identifies the position of the following 
data in the spatial frequency domain and implicitly 
the quantization step width used for the following 
video data 70. The video data is approximately 120 
bytes long and is followed by eight bytes of error 
correction data 72 internal to the block of Figure 
12. 

The block structure of Figure 12 allows the 
blocks to be independent of one another so that 
when only some of the data blocks are recovered 
(e.g. during shuttle replay) they can still be de- 
coded and placed in the appropriate position within 
the replay store and time base corrector 50 of 
Figure 11. 

Claims 

1. Video data compression apparatus comprising: 

means for frequency separating (36) input 
video data into one or more primary compo- 
nents (4, 5, 6), each representing a range of 
spatial frequency content within said input vid- 
eo data, using M frequency separating stages 
and a plurality of secondary components (0, 1 , 
2, 3), each representing a range of spatial 
frequency content within said input video data, 
using N frequency separating stages, N being 
greater than M; and 

a quantizer (40) for quantizing each of said 
primary components with a primary quantiza- 
tion step width Q1 and for quantizing each of 
said secondary components with a secondary 
quantization step width G 2 , where Q1 and Q2 
are substantially given by: 

Q1 = Ki/R(fi) and Q 2 = K 2 /R(f 2 ). 

with 

R(f s ) = relative human visual responsiveness 
at differing spatial frequencies f s , 
f s = spatial frequency in cycle per degree of 
visual angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
secondary component being quantized, and 
K1 and K2 are constants with K1 > K 2 . 

2. Video data compression apparatus as claimed 
in claim 1, comprising an entropy encoder (42) 
for entropy encoding quantized primary and 
secondary component data output from said 
quantizer with a selectable one of a plurality of 
encoding tables. 
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4. 



7. 



10. 



Video data compression apparatus as claimed 
in any one of claims 1 or 2, wherein said 
..secondary components are produced by fur- 
ther separating one or more primary compo- 
nents. 

Video data compression apparatus as claimed 
in any one of claims 1, 2 or 3, wherein R(f s ) is 
substantially given by: 



R(f s ) = a 



(1 



s ) * (e" 



(0.33 



with 

0.8 < a < 1 .2, 

1 .4 < b < 1 .8, and 

0.3 < c < 0.5. 

Video data compression apparatus as claimed 
in claim 4, wherein said video data is lumi- 
nance video data. 

Video data compression apparatus as claimed 
in any one of claims 4 and 5, wherein a = 1.0, 
b = 1 .6 and c ~ 0.4. 

Video data compression apparatus as claimed 
in any one of the preceding claims, comprising 
means for differentially coding DC component 
data using modulo additions in which carries 
are ignored to represent both positive and neg- 
ative differences. 

Video data compression apparatus as claimed 
in any one of claims 1, 2 or 3, wherein R(f s ) is 
substantially given by: 

R(f s ) = a * (1 - e" b fs ) * e- c - ,s , 

with 

1.15 < a < 1.55, 
1 .4 < b < 1 .8, and 
0.25 < c < 0.45. 

Video data compression apparatus as claimed 
in claim 8, wherein said video data is blue 
colour difference chrominance video data. 

Video data compression apparatus as claimed 
in any one of claims 8 and 9, wherein a = 
1.35, b = 1.6 and c = 0.35. 
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with 

1.5 < a < 1.9, 
1.4 < b < 1.8, and 
0.5 < c < 0.7. 

12. Video data compression apparatus as claimed 
in claim 11, wherein said video data is red 
colour difference chrominance video data. 

13. Video data compression apparatus as claimed 
in any one of claims 11 and 12, wherein a = 
1.7, b = 1.6 and c = 0.6. 

14. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein M 
= 1 and N = 2. 

15. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
Ki/K2 is substantially equal to 2. 

16. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
said means for frequency separating separates 
said input video data into three primary com- 
ponents (4, 5, 6) representing a high spatial 
frequency portion of said video data and four 
secondary components (0, 1, 2, 3) represent- 
ing a low spatial frequency portion of said 
video data. 

17. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
said primary components are of a higher spa- 
tial resolution than said secondary compo- 
nents. 

18. Video data compression apparatus as claimed 
in claims 16 and 17, wherein said primary 
components have a spatial resolution twice that 
of said secondary components. 

19. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
said means for separating comprises a branch- 
ing hierarchy of low and high pass filters. 

20. Video data compression apparatus as claimed 
in claim 19, wherein said low and high pass 
filters comprise complementary finite impulse 
response filters. 



11. Video data compression apparatus as claimed 
in any one of claims 1 , 2 or 3, wherein R(f s ) is 
substantially given by: 



R(f s ) = a*(1 -e- bfs )*e 



-c.fs 



21. Video data decompression apparatus compris- 
ing: 

55 a dequantizer (54) for dequantizing each of 

one or more primary components, each repre- 
senting a range of spatial frequency content 
within said input video data, with a primary 
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dequantization step width Qi and dequantizing 
each of a plurality of secondary spatial fre- 
quency, components, each representing a 
range of spatial frequency content within said 
input video data, with a secondary dequan- 5 
tization step width Q2, where Q1 and Q2 are 
substantially given by: 

Q, = Ki/R(fi) and Q 2 = K 2 /R(f 2 ), 

10 

with 

R(f s ) = relative human visual responsiveness 

at differing spatial frequencies f s , 

f s = spatial frequency in cycle per degree of 

visual angle, ?s 

fi = a spatial frequency representative of that 

primary component being quantized, 

f 2 = a spatial frequency representative of that 

secondary component being quantized, and 

K1 and K2 are constants with K1 > K 2 ; and 20 

means for frequency combining (60) said 
dequantized primary components with M fre- 
quency combining stages and said dequan- 
tized secondary components with N frequency 
combining stages, N being greater than M. 25 

22. Video data decompression apparatus as 
claimed in claim 21, comprising 

an entropy decoder (52) for entropy de- 
coding compressed data into said quantized 30 
primary components and said quantized sec- 
ondary components with a selectable one of a 
plurality of decoding tables. 

23. Video data recording and reproducing appara- 35 
tus comprising video data compression ap- 
paratus as claimed in any one of claims 1 to 

20 and video data decompression apparatus 
as claimed in any one of claims 21 and 22. 

40 

24. Video data recording and reproducing appara- 
tus as claimed in claim 23, comprising: 

multichannel recording and reproducing 
heads; 

a demultiplexer (38) for splitting adjacent 45 
samples within each of said primary compo- 
nents and said secondary components be- 
tween different recording channels (A, B t C, 
D); and 

a multiplexer (56) for combining samples 50 
from different reproducing channels to reform 
each of said primary and said secondary com- 
ponents. 

25. Video data recording and reproducing appara- 55 
tus as claimed in any one of claims 23 and 24, 
comprising a data formatter for formatting said 
compressed data in blocks of data each con- 



taining a header identifying a spatial frequency 
domain position to which compressed data 
within said block relates. 

26. Video data recording and reproducing appara- 
tus as claimed in claim 25, wherein each block 
includes error correction data for that block. 

27. A method of compressing video data compris- 
ing the steps of: 

frequency separating input video data into 
one or more primary components, each repre- 
senting a range of spatial frequency content 
within said input video data, using M frequency 
separating stages and a plurality of secondary 
components, each representing a range of 
spatial frequency content within said input vid- 
eo data, using N frequency separating stages, 
N being greater than M; and 

quantizing each of said primary compo- 
nents with a primary quantization step width 
Q1 and for quantizing each of said secondary 
components with a secondary quantization 
step width Q 2 , where Q1 and Q2 are substan- 
tially given by: 

Q^ = Ki/R(fi) and Q2 = K 2 /R(f 2 ), 
with 

R(f s ) = relative human visual responsiveness 
at differing spatial frequencies f s , 
f s = spatial frequency in cycle per degree of 
visual angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
secondary component being quantized, and 
Ki and K 2 are constants with Ki > K 2 . 

28. A method of decompressing video data com- 
prising the steps of: 

dequantizing each of one or more primary 
components, each representing a range of 
spatial frequency content within said input vid- 
eo data, with a primary dequantization step 
width Q1 and dequantizing each of a plurality 
of secondary components, each representing a 
range of spatial frequency content within said 
input video data, with a secondary dequan- 
tization step width Q 2 , where Q1 and Q 2 are 
substantially given by: 

Qt = K,/R(fi) and Q 2 = K 2 /R(f 2 ), 

with 

R(f s ) - relative human visual responsiveness 

at differing spatial frequencies f s , 

f s = spatial frequency in cycle per degree of 
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content of the image. Generally speaking, even 
without the compression process, there is more 
information, contained in the lower frequency com- 
ponents than in the higher frequency components. 
Using the compression process further reduces the 
information content of the higher frequency compo- 
nents relative to the lower frequency components. 
This decorrelation is used to achieve efficient cod- 
ing by subsequently applying techniques such as 
runlength coding and entropy coding. A system 
using the frequency separation technique as illus- 
trated in Figure 1 is described in more detail in 
GB-A-2 251 756. Figure 2 illustrates the relative 
human visual responsiveness R(f s ) to luminance at 
different spatial frequencies f s , Spatial frequency f s 
is measured in cycles per degree of visual angle 
so as to independent of viewing distance from the 
video image reproduction apparatus. The relative 
visual responsiveness R(f s ) is determined empiri- 
cally using a threshold type testing procedure 
whereby luminance variations at a given spatial 
frequency are increased in magnitude until they are 
perceived by the viewer. 

Figures 3A and 3B illustrates the relative hu- 
man visual responsiveness R(f s ) to chrominance at 
differing spatial frequencies in an analogous man- 
ner to Figure 2. The chrominance signals can be 
B-Y or R-Y colour difference signals. It will be seen 
that the relative human visual responsiveness to 
chrominance has a sharper peak at the low spatial 
frequencies and more rapidly declines to zero to- 
wards the high spatial frequencies. 

Both Figure 2 and Figures 3A and 3B illustrate 
the variation in relative visual responsiveness at 
differing spatial frequencies (given in cycles per 
degree of visual angle) in one dimension. A surface 
mapping the relative human visual responsiveness 
to spatial frequency in two dimensions can be 
obtained by rotating each of the curves of Figure 2 
and Figures 3A and 3B about the R(f s ) axis. Figure 
3A shows the R-Y colour difference responsiveness 
and Figure 3B shows the B-Y colour difference 
responsiveness. The magnitudes of the R-Y re- 
sponsiveness are greater than those of the B-Y 
responsiveness in line with the empirically deter- 
mined relationships discussed above. 

Figure 4 illustrates an image transformed into 
non-uniform frequency components in the two-di- 
mensional spatial frequency domain. The image is 
transformed into three primary components (com- 
ponents 4, 5, 6) and four secondary components 
(components 0, 1, 2, 3). The component 0 cor- 
responds to the DC subband of Figure 1. Each of 
the secondary components occupies one quarter of 
the area in the spatial frequency domain compared 
to the primary components. Moving rightwards and 
downwards in the transformed image corresponds 
to an increase in spatial frequency. The primary 



components are subject to one stage of frequency 
separation and subsequently one stage of frequen- 
cy combination, whereas the secondary compo- 
nents are subject to two stages of frequency sepa- 
s ration and subsequently two stages of frequency 
combination. 

Figure 5 illustrates the stages in the frequency 
separation process. An image 4 in the spatial do- 
main is first subject to complementary low and 

w high pass filtering in both the horizontal and vertical 
directions to split it into four primary sub bands in 
the spatial frequency domain 6 (Stage 1). The 
lowest frequency component 8 corresponds to the 
DC component 2 of Figure 1 and Figure 2. 

75 The lowest frequency component 8 alone is 

then subject to further splitting by low and high 
pass filters in both the horizontal and vertical direc- 
tions to form four secondary components (Stage 
2). The primary components (components 4, 5, 6) 

20 other than lowest frequency component 8 remain 
unchanged during Stage 2. 

The spatial frequency separation by low and 
high pass filtering includes decimation of the sam- 
ple data so as to maintain as constant the number 

25 of data values representing the particular content of 
the image in a different domain. 

Figure 6 illustrates the relative quantization 
step widths applied to the primary and secondary 
components. The quantization step widths increase 

30 as spatial frequency increases. The quantization 
step widths for the primary components are double 
those that would be used if based purely upon the 
relative human visual responsiveness as illustrated 
in Figure 2 and Figure 3. The quantization step 

35 widths increase less rapidly with increasing vertical 
spatial frequency since the image in the spatial 
domain is an interlaced field image rather than 
being a full vertical resolution frame image. 

Figure 7 illustrates the variation in quantization 

40 step width with spatial frequency as used in Figure 
6. The curve ABC represents the inverse of the 
curves illustrated in either Figure 2 or Figure 3 
depending on whether it is luminance or chromin- 
ance data that is being processed. The curve ABC 

45 is that used to generate the quantization step 
widths in the system disclosed in GB-A-2 251 756. 
In contrast, for this embodiment of the present 
invention, the curve DE is used to derive the quan- 
tization step widths for the upper half of the spatial 

so frequencies. For a given point along the curve BC, 
the corresponding point of the same spatial fre- 
quency along the curve DE represents double the 
quantization step width. There is a discontinuity at 
BD. 

55 Figure 8 schematically illustrates a branching 

hierarchy of low and high pass filters that can be 
used to perform non-uniform frequency separation. 
Input video data 10 is split into a low frequency 
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portion 12 and a high frequency portion 14 by 
respective low and high pass filters. These low and 
high-frequency portions 12, 14 are decimated so as 
to preserve the overall data rate. The low fre- 
quency portion 12 is further split by a second 
stage of low and high pass filtering to produce a 
low frequency portion 16 and a high frequency 
portion 18. Once again, the low and high frequency 
portions 16, 18 are decimated so as to preserve 
the data rate. The low frequency portion 14 result- 
ing from the first stage of frequency separation 
forms a primary component. The low and high 
frequency portions 16, 18 resulting from the sec- 
ond stage of frequency separation form secondary 
components. 

The frequency splitting illustrated in Figure 8 is 
in one dimension. It will be appreciated that fre- 
quency splitting in the other dimension will be 
achieved with another branching hierarchy of filters. 
The filters used are finite impulse response filters 
employing either sample or line delays depending 
upon whether horizontal or vertical filtering is re- 
quired. 

Figure 9 illustrates one form of the means for 
frequency separating. Input video data 20 is sup- 
plied to a complementary low and high pass filter 
arrangement 22 where it is split into two horizontal 
bands using finite impulse response filters with 
sample delays. The data thus split is then passed 
to another low and high pass filter arrangement 24 
where it is further split into two vertical bands using 
finite impulse response filters with line delays. The 
data output from the filter arrangement 24 is sam- 
ple multiplexed with interleaved high and low com- 
ponents as described in copending British Patent 
Application 9118167.7 (Sony Broadcast & Commu- 
nications Limited). At this point the image is written 
into a field store 26 which serves to convert it from 
sample multiplexed form into the form illustrated 
after Stage 1 in Figure 5. 

The lowest horizontal and vertical frequency 
component from the primary components stored in 
the field store 26 is then subject to a second stage 
of horizontal and vertical frequency splitting by the 
high and low pass filter arrangements 28, 30. The 
high and low pass filter arrangements 28, 30 are 
disabled for the remaining primary components 
other than the lowest horizontal and vertical fre- 
quency primary component. The output from the 
filter arrangement 30 is written into the field store 
31 where it is transformed from sample multiplexed 
form into the form illustrated after Stage 2 in Figure 
5. 

Figure 10 illustrates another embodiment of the 
means for frequency separating. In this embodi- 
ment, input data 20 is subject to a first stage of 
horizontal frequency separation by the filter ar- 
rangement 22 (sample delays) and then the lower 



horizontal frequency component alone is subject to 
a second stage of horizontal frequency separation 
by the filter arrangement 25. The data is then 
written into field store 27 where it is transformed 
5 from its sample multiplexed format into a format in 
which the differing horizontal components are sep- 
arated. 

The data from the field store 27 is then trans- 
posed and passed through a first stage of vertical 

70 filtering by the filter arrangement 23 (sample de- 
lays can be used since data has been transposed; 
this is easier to implement than having to provided 
the buffering necessary for line delays) and then 
the lower vertical frequency components alone is 

75 subject to a second stage of vertical frequency 
separation by the filter arrangement 29. The output 
from the filter arrangement 29 is then written into a 
field store 31 where it is rearranged into the format 
shown. As a consequence of both stages of hori- 

20 zontal filtering being performed before the vertical 
filtering is that the low horizontal and high vertical 
spatial frequency component of Figure 9 is now 
split in two horizontally since at the time of the 
second stage of horizontal filtering there has not 

25 yet been any vertical frequency separation that 
could be used to avoid this extra splitting. The 
effective quantizing steps applied to these two 
areas is scaled by a factor of 2 1/2 rather than 2 as a 
result of the extra stage of horizontal decimation. 

30 Figure 11 illustrates a recording and reproduc- 

ing apparatus 32. Input data 34 is supplied to a 
wavelet decimation unit 36 where it undergoes fre- 
quency separation as illustrated in Figure 5. The 
frequency separated data is then demultiplexed by 

35 a demultiplexer 38 onto four separate processing 
channels A, B, C, D whereby adjacent samples 
within the array of samples are placed on differing 
channels as schematically illustrated below the de- 
multiplexer 38 in Figure 1 1 . 

40 The four channels of demultiplexed data A, B, 

C, D are then fed to a quantizer 40 where they are 
subject to individual channel quantization using the 
quantization step widths given in Figure 6 in de- 
pendence upon which frequency component the 

45 data being processed originates from and the over- 
all data rate required. 

The quantized data is then passed to an en- 
tropy encoder 42 where it is subject to runlength 
and Huffman coding. The entropy encoder 42 uses 

so different coding tables for the different frequency 
components. 

The frequency transformed, demultiplexed, 
quantized and entropy encoded data is then pack- 
aged into data blocks by a channel encoder 44. 

55 These data blocks are then written via a tape 
transport mechanism onto a magnetic tape 46. 

As an alternative to the above the DC compo- 
nent data may be subject to differential coding 
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(DCPM) to improve coding efficiency. The DC val- 
ues are typically represented by 12 bit numbers. 
The differences are encoded as modulo 2 12 values 
irrespective of whether they are positive or nega- 
tive differences. Upon decoding the difference are 
added to the current 12 bit number with any carry 
bits being ignored. In this way a negative dif- 
ference can be achieved by adding a large number 
that takes the total through a bit carry and returns a 
modulo 2 12 result that is lower than the previous 
total. Avoiding the need to support negative differ- 
ences with a sign bit or the like simplifies im- 
plementation. 

Data blocks recovered from the magnetic tape 
46 are read by a channel decoder 48 which at- 
tempts a first level of error correction and marks 
any data subject to error. The channel decoder 
then passes the data to a replay store and time 
base corrector 50. The replay store and time based 
corrector 50 allows an image to be produced when 
only some of the data is recovered by utilising data 
previously written into the replay store. 

The data from the replay store and time base 
corrector 50 is fed to an entropy encoder 52 where 
it is decoded in a complementary manner to the 
encoding process applied by the entropy encoder 
42. The entropy decoder 52 uses selectable de- 
coding tables dependent upon which frequency 
component the data being decoded originates 
from. 

The output from the entropy decoder 52 is fed 
to a dequantizer 54 which dequantizes the decoded 
data using a dequantization step width complemen- 
tary to that applied for the frequency component 
being processed by the quantizer 40. 

The output from the dequantizer 52 is fed to a 
multiplexer 56 where the four channels A, B, C, D 
are combined and then passed to an error conceal- 
ment unit 58. The error concealment unit 58 per- 
forms error concealment upon any samples flagged 
as erroneous by the channel decoder 48 using a 
selectable strategy of interpolating replacement val- 
ues from surrounding values. The strategy can be 
adapted in dependence upon which frequency 
component the error being concealed is present in. 

The output from the error concealment unit is 
fed to wavelet reconstruction unit 60 where the 
data is transformed from the spatial frequency do- 
main to the spatial domain by a complementary 
array of interpolation filters to the frequency sepa- 
ration filters in the wavelet decimation unit 36. The 
output 62 from the wavelength reconstruction unit 
is a reproduced image in the spatial domain. 

Figure 12 illustrates a data block of the type 
into which the image data is split and recorded 
upon the magnetic tape 46 of Figure 11. The data 
block includes a two byte fixed synchronisation 
pattern 64, a two byte channel identifier 66 (indicat- 



ing which of channels A, B, C, D the data is from), 
a four byte entropy encoding identifier 68 indicat- 
ing which entropy coding table was used for the 
following video data 70. The entropy coding iden- 

5 tifier 68 also identifies the position of the following 
data in the spatial frequency domain and implicitly 
the quantization step width used for the following 
video data 70. The video data is approximately 120 
bytes long and is followed by eight bytes of error 

w correction data 72 internal to the block of Figure 
12. 

The block structure of Figure 12 allows the 
blocks to be independent of one another so that 
when only some of the data blocks are recovered 
75 (e.g. during shuttle replay) they can still be de- 
coded and placed in the appropriate position within 
the replay store and time base corrector 50 of 
Figure 11. 

20 Claims 

1. Video data compression apparatus comprising: 

means for frequency separating (36) input 
video data into one or more primary compo- 

25 nents (4, 5, 6), each representing a range of 

spatial frequency content within said input vid- 
eo data, using M frequency separating stages 
and a plurality of secondary components (0, 1 , 
2, 3), each representing a range of spatial 

30 frequency content within said input video data, 

using N frequency separating stages, N being 
greater than M; and 

a quantizer (40) for quantizing each of said 
primary components with a primary quantiza- 

35 tion step width Qi and for quantizing each of 

said secondary components with a secondary 
quantization step width Cb, where Qi and Q2 
are substantially given by: 

40 Qi = Ki/R(fi) and Q 2 = te/Rfc), 

with 

R(f s ) = relative human visual responsiveness 
at differing spatial frequencies f s , 
45 f s = spatial frequency in cycle per degree of 

visual angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
50 secondary component being quantized, and 

K1 and K2 are constants with K1 > K2. 

2. Video data compression apparatus as claimed 
in claim 1, comprising an entropy encoder (42) 

55 for entropy encoding quantized primary and 

secondary component data output from said 
quantizer with a selectable one of a plurality of 
encoding tables. 
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3. Video data compression apparatus as claimed 
in any one of claims 1 or 2, wherein said 

. secondary components are produced by fur- 
ther separating one or more primary compo- 
nents. 5 

4. Video data compression apparatus as claimed 
in any one of claims 1, 2 or 3, wherein R(f s ) is 
substantially given by: 

w 

R(f s ) = a * (1 - e" bfs ) * (e" cfs + (0.33 * 

e -0,33.c.fsjj 

with 

0.8 < a < 1.2, is 
1 .4 < b < 1 .8, and 
0.3 < c < 0.5. 

5. Video data compression apparatus as claimed 

in claim 4, wherein said video data is lumi- 20 
nance video data. 

6. Video data compression apparatus as claimed 
in any one of claims 4 and 5, wherein a = 1 .0, 

b = 1 .6 and c = 0.4. 25 

7. Video data compression apparatus as claimed 
in any one of the preceding claims, comprising 
means for differentially coding DC component 
data using modulo additions in which carries 30 
are ignored to represent both positive and neg- 
ative differences. 

8. Video data compression apparatus as claimed 

in any one of claims 1 , 2 or 3, wherein R(f s ) is 35 
substantially given by: 



with 

1.5 < a < 1.9, 
1.4 < b < 1.8, and 
0.5 < c < 0.7. 

12. Video data compression apparatus as claimed 
in claim 11, wherein said video data is red 
colour difference chrominance video data. 

13. Video data compression apparatus as claimed 
in any one of claims 11 and 12, wherein a = 
1.7, b = 1.6 and c = 0.6. 

14. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein M 
= 1 and N = 2. 

15. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
K1/K2 is substantially equal to 2. 

16. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
said means for frequency separating separates 
said input video data into three primary com- 
ponents (4, 5, 6) representing a high spatial 
frequency portion of said video data and four 
secondary components (0, 1, 2, 3) represent- 
ing a low spatial frequency portion of said 
video data. 

17. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
said primary components are of a higher spa- 
tial resolution than said secondary compo- 
nents. 



10. 



R(f s ) = a*(1 -e" b,s )*e . 

with 40 
1.15 < a < 1.55, 
1 .4 < b < 1 .8, and 
0.25 < c < 0.45. 

Video data compression apparatus as claimed 45 
in claim 8, wherein said video data is blue 
colour difference chrominance video data. 

Video data compression apparatus as claimed 

in any one of claims 8 and 9, wherein a = 50 

1.35, b = 1.6 and c = 0.35. 



18. Video data compression apparatus as claimed 
in claims 16 and 17, wherein said primary 
components have a spatial resolution twice that 
of said secondary components. 

19. Video data compression apparatus as claimed 
in any one of the preceding claims, wherein 
said means for separating comprises a branch- 
ing hierarchy of low and high pass filters. 

20. Video data compression apparatus as claimed 
in claim 19, wherein said low and high pass 
filters comprise complementary finite impulse 
response filters. 



11. Video data compression apparatus as claimed 21. 
in any one of claims 1 , 2 or 3, wherein R(f s ) is 
substantially given by: 55 

R(f s ) = a*(1 -e- b - ,s )*e~ c - fs , 



Video data decompression apparatus compris- 
ing: 

a dequantizer (54) for dequantizing each of 
one or more primary components, each repre- 
senting a range of spatial frequency content 
within said input video data, with a primary 
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dequantization step width Qi and dequantizing 
each of a plurality of secondary spatial fre- 
quency components, each representing a 
range of spatial frequency content within said 
input video data, with a secondary dequan- 
tization step width G2, where Q1 and Q2 are 
substantially given by: 

Qt = Ki/R(fi) and Q 2 = K 2 /R(f 2 ), 

with 

R(f s ) = relative human visual responsiveness 
at differing spatial frequencies f s , 
f s = spatial frequency in cycle per degree of 
visual angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
secondary component being quantized, and 
K1 and K2 are constants with Ki > K2 ; and 

means for frequency combining (60) said 
dequantized primary components with M fre- 
quency combining stages and said dequan- 
tized secondary components with N frequency 
combining stages, N being greater than M. 

22. Video data decompression apparatus as 
claimed in claim 21, comprising 

an entropy decoder (52) for entropy de- 
coding compressed data into said quantized 
primary components and said quantized sec- 
ondary components with a selectable one of a 
plurality of decoding tables. 

23. Video data recording and reproducing appara- 
tus comprising video data compression ap- 
paratus as claimed in any one of claims 1 to 
20 and video data decompression apparatus 
as claimed in any one of claims 21 and 22. 

24. Video data recording and reproducing appara- 
tus as claimed in claim 23, comprising: 

multichannel recording and reproducing 
heads; 

a demultiplexer (38) for splitting adjacent 
samples within each of said primary compo- 
nents and said secondary components be- 
tween different recording channels (A, B, C, 
D); and 

a multiplexer (56) for combining samples 
from different reproducing channels to reform 
each of said primary and said secondary com- 
ponents. 

25. Video data recording and reproducing appara- 
tus as claimed in any one of claims 23 and 24, 
comprising a data formatter for formatting said 
compressed data in blocks of data each con- 



taining a header identifying a spatial frequency 
domain position to which compressed data 
within said block relates. 

5 26. Video data recording and reproducing appara- 
tus as claimed in claim 25, wherein each block 
includes error correction data for that block. 

27. A method of compressing video data compris- 

70 ing the steps of: 

frequency separating input video data into 
one or more primary components, each repre- 
senting a range of spatial frequency content 
within said input video data, using M frequency 

75 separating stages and a plurality of secondary 

components, each representing a range of 
spatial frequency content within said input vid- 
eo data, using N frequency separating stages, 
N being greater than M; and 

20 quantizing each of said primary compo- 

nents with a primary quantization step width 
Qi and for quantizing each of said secondary 
components with a secondary quantization 
step width Q2, where Qi and Q2 are substan- 

25 tially given by: 

q, = Ki /R(fi ) and Q 2 = K 2 /R(f 2 ), 
with 

30 R(f s ) = relative human visual responsiveness 

at differing spatial frequencies f s , 
f s = spatial frequency in cycle per degree of 
visual angle, 

fi = a spatial frequency representative of that 
35 primary component being quantized, 

f 2 = a spatial frequency representative of that 
secondary component being quantized, and 
Ki and K2 are constants with Ki > K 2 . 

40 28. A method of decompressing video data com- 
prising the steps of: 

dequantizing each of one or more primary 
components, each representing a range of 
spatial frequency content within said input vid- 

45 eo data, with a primary dequantization step 

width Qi and dequantizing each of a plurality 
of secondary components, each representing a 
range of spatial frequency content within said 
input video data, with a secondary dequan- 

50 tization step width Q 2 , where Qi and Q 2 are 

substantially given by: 

Qi = Ki/R(fi) and Q 2 = K 2 /R(f 2 ), 

55 with 

R(f s ) = relative human visual responsiveness 

at differing spatial frequencies f s , 

f s = spatial frequency in cycle per degree of 
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visual angle, 

fi = a spatial frequency representative of that 
primary component being quantized, 
f 2 = a spatial frequency representative of that 
secondary component being quantized, and 5 
Ki and K2 are constants with Ki > K2 ; and 

frequency combining said dequantized pri- 
mary components with M frequency combining 
stages and said dequantized secondary com- 
ponents with N frequency combining stages, N 10 
being greater than M. 
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© A video data compression system is described 
utilising frequency separation and quantization. The 
video data is separated into primary frequency com- 
ponents (components 4, 5, 6) and secondary fre- 
quency components (components 0, 1, 2, 3), The 
primary frequency components undergo fewer fre- 
quency separating stages (N > M) than the secon- 
dary frequency components. The quantization step 
width (Q 1( Q 2 ) applied to the differing primary and 
secondary components is varied in dependence 
upon the relative human visual responsiveness (R- 
(f s )) to the spatial frequency (f s ) represented by that 
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component. In addition, those frequency components 
that have undergone fewer frequency separating 
stages are subject to a larger quantization step width 
than the other frequency components since the few- 
er frequency combination stages such frequency 
components will subsequently undergo has the re- 
sult that the image degradation introduced by quan- 
tization is less noticeable. The system also includes 
entropy encoding (42) using selectable complemen- 
tary encoding and decoding tables. The system is 
particularly applicable to recording and reproducing 
apparatus. 
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